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ABSTRACT 

Three obstacles appear to frustrate the potential 
contribution of empirical research and social science to policy 
formulation. First there is the inherent conflict in the political 
decision making process; second, reality is so complex it defeats our 
ability to locate the sphere of understanding which we should apply; 
third, knowledge presupposes a framework to interpret it; but in a 
pluralistic system there are only competing frameworks. The work of 
Kuhn may be relevant for understanding the contribution of social 
science research to established social policy paradigms. In this 
paper, the resistance of personal paradigms to change is illustrated, 
as well as the stubborness of categories of thought despite 
alternatives suggested by research. Skeptics take this as evidence 
that only a weak link is possible between research and policy* 
Optimists argue that such a conclusion is premature* Research 
undertaken within a common framework of thoi^ght can both by 
contention and concensus influence the d^^/elopnent of policy; 
moreover, research and theory can help reshape policy paradigms as 
well, but their contributions cannot be isolated from the many other 
forces that impinge on decisions. The final section illustrates how 
prior-held frameworks shape the ideals sought (the skeptic's view), 
the theories of action proposed, and the evaluations undertaken. 
(Author/JM) 
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VALUES, SOCIAL SCIENCE, AND SOCIAL POLICY* 
Martin Rein 

The Relationship Between Reason and Purpose 

It is almost univerally acknowledged that rational thought should inform the 
development of public policies. The term "rational thought" may not acutally be 
used, but the view that policy should be the consequence of rational review is so 
thoroughly accepted that it is not seen to deserve notice. Yet, implicitly or explicitly, 
the assumption remains. 

Often this assumption is associated with the set of beliefs we might identify as the 
"science and technology" dogma. According to these beliefs, we have a field of 
study of reality, science, which producer, fundamental understandings, and then another 
field concerned with practicol applications, technology, which solves problems of 
immediate human concern through the application of the appropriate elements of 
our fundamental understanding. In the area of social policy, according to this view, 
we must develop an understanding of social reality so that we can subsequently apply 
that understanding to the development of social policies. Research should be directed 
at increasing our fundamental understanding of social conditions and the processes 
that create them. Although the proper intemrotation and application of that under- 
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standing may cai! for unu^uu! experience, Inblgln, ond powei^ of invenlion, Ine 
research findings will confain the materials on which the application can be based. 
Administrative and political problems may Inhibit the process but, in principle, it 
should be possible to complete the sequence of research leading to understanding and 
of understanding leading to recommendation. Or, in a more sophisticated form of 
the science and technology view, we may think of the process as iterative and believe 
that we can move from research to initial understanding to application, to more 
research, to further understanding and new application,to recognition of new problems, 
to still more research, etc. In short, a procedure can be established which permits 
learning from new experiences. 

These assumptions are not so much false as overstated. The assumptions are 
plausible, and so they contribute to inevitable frustration when an increase in 
knov/ledge Js riot, after all, accompanied by an increase in our ability to design and 
change policy. 

This frustration leads to a new skepticism about our ability to propose rational 
prescriptions on the basis of a dispassionate analysis of the nature cf the problems 
and an evaluation of the limitations of present programs to cope with them. Alice 
Rivlin, after attempting to evaluate the usefulness of the PPBS system (Planning- 
Programming-Budgeting System) introduced in the federal government, concluded 
that "So far analysts have probably done more to reveal how difficult the problem; 
and choices are than to make the decisions easier. The efforts to make use of 
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Alice Mo Rivlin, Systematic Thinking for Social Action , Vycshington, D,C.: The 
Brookings Institution, 1971. 



systematically gathered and scientifically based information in policy decision 
making have revealed only how difficult it is to make choices when policy requires 
the synthesis of multiple, equally valued but conflicting objectives. A recent 
statement by Ida Merriam, Assistant Commissioner of Research for the Spcial Security 
Administration, expresses the frustration even more pointedly: She writes: "There 
is a growing recognition that much of the federally supported extramural research, 
particularly in the social sciences, has added little or nothing either to basic know- 
ledge or to practical decision-making. " This view is widely held. Whether it is 
in fact valid must itself be the subject of further study. 

Three obstacles appeor to frustrate the potential contribution of empirical 
research and social science theory and knowledge, more broadly defined, to policy 
formulation. First, there is the inherent conflict in the political decision-making 
process: different people want different things and make use of the political process 
to satisfy their respective interests; second, reality is so complex it defeats our 
ability to locate the sphere of understanding which we should apply; third, know- 
ledge presUf. OSes a framework to interpret it; but in a pluralistic system there are 
only competing frameworks, and social science findings are seldom so conclusive 
that they permit a firm choice among competing perspectives. I want briefly to 
call attention to the first two types of obstacles and then to elaborate on the third. 



Ida Merriam, "Social Security Research: The Relation of Research and Policy 
Planning in a Government Agency, " Journal of Social Policy, Vol. 1, Pari' 4, 
October 1972, p. 290. 
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Democracy and Rational Decis ion-Making 

Tlic conflict between rationality ind democracy derives from the widely held 

view, at \oCiJ among American political scientists, that there is no public interest 

wiiich can be distinguished from sectional and group interests. "The grounds advanced 

by the. . group theoristb fo denying the existence of the public interest are that as 

any proposal which becomes practical oolitics is opposed by some group, there cannot 
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therefore be a single public interest. ' In democratic societies there are only 
conflicting interest:>, oo'Jh seeking to maximize its Influence through the political 
process. Even thed^.-ire by sc>ciai scientists to make use of rational analysis in 
Influencing public policy must also be interpreted as a form of partisanship, one 
rooted in the desire to win more influence for academics and, correspondingly, to 
weaken the influence of other groups who now shape policy. 

To make this general discussion about Interest groups and information more concrete, 
v^e may consider ti^e foljov/ing sltuorion. 

Policy cuncerned Yvltit the bulUHr.j of atomic generating plants, so long as this remains 
an economic is:,ue, cnn be decided i: / reference to piojectlons of future energy needs 
and b/ considerr:tion of economieo ond diseconomies. There wiH, of course, be 
Interest groops wnooc o^n economic stake is dependent on the uiillzatlon of one sort 
of fuel or cnoih'^ji, ir. ^onririucd expansion of energy resources, or rho like. But 
the trade-offs will be fairly clear to begin with, or will become so after a while, and 
compromise may reached. If not, then the conflict will, at least, be between clearly 
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Identified adversaries over clearly defined issues. There is a procedure for resolving 
conflicts of efficiency which is generally accepted. But when construction of the 
atomic generating plant takes on social implications, when it is recognized that the 
plant will contribute new danger to its environs or raise issues about the social conse- 
quences of various waste disposal programs, the matter becomes more complex. Now 
ther^ are many more parties than can easily be dealt with; they include all those who 
were previously engaged and, in addition, defenders of the neighborhood or community, 
environmentalists, and the like. Compromises become extraordinarily difficult to work 
out, partly because so much of the cost, to some of the parties at least, is in their 
anticipated quality of life. It helps, of course, to have as much understanding as 
possible of the reality under debate; byt the debate cannot be ended by this additional 
understanding; and since the debate becomes more complex, and the competfng values 
and interest groups become more visible, the issue may appear insoluble. Nor could 
it have been entirely anticipated that the pollution potential of the enterprise would 
become a salient public issue. Economic gain and loss is a persistent concern, but 
beliefs about what determines the quality of our lives are constantly subject to change 
and redefinition. There is no consensus about how to sum up the costs and benefits 
to different groups or the weights to assign to economic gains and social externalities. 

There is an intractable conflict of purposes between political decision making, 
which is about the power of composing interest groups, and analytic research, which 
is about rational problem solving. Rationality does not, in rhis context, imply that 
some definable logical procedure has been followed which has exhaustively scrutinized 
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all possible options or considered all relevant information. Rather, it suggests that, 
at the leost, the process of making a decision intelligibly made use of whatever 
resources of knowledge, judgment, imagination, and analysis were available in the 
circumstances. The worrying question. Is, nevertheless, whether the political system 
IS capable of acting intelligently in some nonpartisan sense? Or is the whole rx^tion 
of impartial intelligence inapplicable because there is no common good or esta- 
blished means of determining it? 

One suggestion for the resolution of this problem is to distinguish between 
questions of imphmentation and questions of policy. Questions of implementation 
assume that the objective is given and ask only how to reach it, or what other 
unintended consequences might follow from the pursuit or achievement of the accepted 
objective. Questions of policy, by contrast, ask for an ordering of goals or objectives. 
These questions are less amenable to dispassionate understanding. 

But efforts to distinguish between ends and means are often superficial. The 
consideration of one reqiiires elimination of the other. There is, then, not much to 
be gained from efforts to delineate the terrain of policy and research or to treat 
them as separate worlds. Although conceptually they may be distinct from one 
another, there is a natural interplay between them when they operate in the real 
world. 

Other efforts to integrate research and the political process start at the other end 
and argue that research nust accommodate itself to the political process. The task is 
first \o understutid better hov. decisions are taken in government, and then, based on 
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this understanding, determine where and how in the process research can best be intro- 
duced. Research must therefore be more flexible and resilient if it is to ba of use to 
political leaders and administrative heads. 

Still others take the view that "There can be no agreement either on goals or on 
societal relationships that link program inputs to sought-after outputs, o . . American 
society is inherently Incapable of being goal-oriented for deep-seated ideological 
reasons; accordingly, applied cybernetic rationality cannot be the basis of social 
accounting. Aside from ideological issues, the extraordinary difficulty of recon- 
ciling and weighting multiple and conflicting interests limits the potential for rational 
policy making. We must accept, therefore, as the best solution whatever the political 
process produces. But sometimes those who hold this view go farther by identifying fhe 
political process itself with rational decision making. The disjointed-incremental 
school holds that wher. cerrain conditions are met, such as representation of all 
interested parties in the political process, the outcome must yield a rational decision. 
This is what Mannheim tprm^d "procedural rationality. " But this view is also vulner- 
able. Though the process may be just, its product may stIM be both unjust and unrela- 
ted to the knowledge base. 

The Complexity of Social Phenomon o 

Even where there arc no immediate clashes of interest, implementation of research 
findings may still be problematic because of the complexity of the situation for which 
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Brian J. L Berry, "Social Accounting Systems: Problems in Conceptualization and 
Realiz.ation, " a paper presented at ihc annual meeting of Hie National Academy of 
Sciences, May 1972. 
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policy is being proposed. Head Start offers an example. It is not at all clear where the roots 
of academic competence are to be found, or how certain is the link between academic 
achievement and future earnings; and so the underlying theory of the program is uncertain. 
But even assuming we knew that academic competence begins with very early exposure to 
academic tools, and we accepted such competence as a good in its own right, we would 
still have to knov*' how schools, teachers, families and peers impinged on Head Start 
students in order to know how Head Start itself, as an application, worked. This is not 
to claim that the program does not v»ork or should not have been tried. It does suggest, 
however, that in social areas the success of an application depends on the impact of diverse 
f ;tors in addition to the one we regard as fundamental. 

In this context, it may be useful to distinguish between the kinds of laws which 
emerge from physical laboratories and, in turn, which guide applied research in the 
industrial laboratories, as opposed to the kinds of understandings which come out of 

the sociological study of real situations, but which rarely lead to the formulation of 

5 

regularities. Instead, the latter tend to describe the functioning of what Lawrence 
Frank has called "organizeJ complexities. " These complexities are affected by 
external events, cjncl :x) long as the oxter nalities are unknown, there will continue 
to be uncertainties about t^e future even though there may be full knowledge about 
the past. 

In no area oi 'J-j'Jy can inferences based on our past research be applied to a 
situation tiiut hos "significantly" changed. And the likelihood of significant change in 
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Such .^jyulontie'. do exist, for exaniplvO, some have been Identified In r-elation to the 
dependence of young children on attachment figures for hcolthy development. This 
example has important applications that are not Immediot:' for instance for persona 
lity in later life, and for the problems early deprivation J yes rise to. 

10 
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social areas seems unusually great. The only means to determine whether tha new 
situation js comparable to the old one has to be applied ex post facto. For this 
reason, knowledge in the policy arena is not entirely ::elf-correctIng., Scien*-ific 
research requires that one continue to experiment until the experimental results and 
the theory correspond, with the data serving as a correction to the theory and the 
theory as a guide to the experiment. But in policy-oriented research, there Is no way 
of anticipating dramatic changes in the social context which will have serious conse- 
quences for the implementation of whatever policies are selected. A reasoned 
argument based on post situations must surrender to the uncertainty of future events, 
thus weokening the knowledge base from which polscy proceeds. 

Ideology and Research 

These problems arising from the complications of competing interests and the 
complexities involved in predicting social events lead to the suggestion that we replace 
our former model of rational thought with a new one. In this modified model we would 
not expect research to lead from understanding to policy, but we would see each 
policy as a probe, which enables us to acquire new insights into the current nature 
of reality. Research would therefore contribute more modestly only to the adaptation 
of policies to changing or unpredlctod events. 

But this more modest modetolso, proves faulty. The difficulty arises from our 
own processes of learning and organizing understanding. New information is assimila- 
ted into a paradigm that is remarkably persistent and resistant to change^ Policy 
paradigms are a curious admixture of psychological assumptions, scientific concepts. 
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value commitments, social aspirations, personal beliefs, and odmin^s^rative constraint. 
They do not constitute a social science theory in the sense of being able to organize 
disparate evidence and predict future patterns. They are more like personal belief 
systems, not entirely manifest, encompassing various contradictions rather than seeking 
to eliminate them. It seems obvious that we need to distinguish between personal and 
collective paradigms, but we do not understand much about the development of either. 

The term paradigai is used here to suggest a working model of why things are as they 
are. It therefore often provides a guiding metaphor of how the world works which 
implies a general direction for intervention: it is more specific than an ideology or 
a system of beliefs but broader than a principle of intervention. The concept of the 
poverty cycle is an exaaiple of a policy paradigm. The imagery of a vicious cycle 
provides a working model of the causa! interactions that are believed to result in 
poverty, a moral interpretation of the responsibility for intervening in this causal 
chairv and a guide to the interventions tliat are therefore relevant and right. It is 
a problem -solving framework, which implies values and benefl*-" Lur aiso pro'^edures, 
habits of thought, and a view of how society functions. 

Typically we incorporate nev/ sources of kncw!edge a. id information so that they 
are compatible with the policy paradigm we hold. And while it does appear tliat new 
paradigms wfll under certain circurrii,iunceG achieve hegemony, the process by which this 
occurs is not well understood. Some will argue that it is not so much that people ch:inge 
their paradigms a:, that the peoplj who hold unsatisfac!ory ones die out or are ''epudiated. 
Yet to suggest that individuals ne/er change their paradigms is to overstote the case. 
Some individuals chonge tiieir mltici^ when there is strong Invalidating information. Many 
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revise theii sense of reality in response to depressions and wars. But whether the 
often ambiguous and incomplete information derived from social science research can 
also serve to modify the belief systems we hold would seem, in er^l, unlikely, 
unless we have only loose attachment to these beliefs, 

Latusconsidera specific example to illustrate how a paradigm can resist change. 
In cities throughout the United States there has been a substantial increase in educa- 
tional expenditures for ghetto schools due to the introduction of compensatory progroms. 
But studies of these efforts indicate that they have contributed little to changing the 
level of educational achievement as measured by standardized t^stso A RAND study 
which reviewed educational reforms such as the augmentation of resources. Improve- 
ments in the processes and methods of education, and variations in the organizational 
environment of the school, came to the conclusion that "Research has found nothing 
that consistently and unambiguously makes a difference in student outcomes. • • • 
Research has not discovered any educational practice that offers a high probability 
of success, What caa be said about these findings? After the methodological 
battles are aired, the implications remain stubbornly inconclusive, largely because 
the same evidence can be used to support sharply different views. Those who were 
initially committed to the reduction of educational inequality can argue that the 
findings demonstrate only that nor , - J'\ has been done. Those who were initially 
skeptical that academic potuntiai ccjn be modified will say that the findings confirm 
their presumptions, 

6 

Harvey A. Avercfi, et al.. How Effective is Schooling? A Critical Review and 
Synthesis of Research Findings, Rgnd Corporation, December 1971, p, iv. 
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The mterprototionof the impact of research on social policy is typically integra- 
ted with beliefs about the ability and responsibility of government to intervene in the 
process. Some hold the view that continuity of commitment must be sustained by govern- 
ment even when programs fail, becausewhen we jettison programs we also abandon 
commitment to the ideals they represent* Moreover the programs may be rejected 
prematurely as failures: "Let us suppose that a man is drowning thirty feet from shore* 

A rescuer throws him ten feet of rope. He drowns. It would scarcely be logical to 

7 

conclude: •Rope is no use in the prevention of drowning,'" Failure, according to 

this framework, osurrlly demonstrates that the program had not tried hard enough, long 

enough, consistently enough, and with sufficient resources to accomplish its task* In 

his message to Congress in support of the Equal Educational Opportunities Act of 1972, 

President Nixon adopted something of this view: 

While there is a great deal yet to be learned about the design of 
successful compensatory programs, the experience so far does 
point in one crucial direction: to the importance of providing 
sufficiently concentrai-»=^d funding to establish the educational 
equivalent of a "critical mass, " or threshold level* Where 
funds have been spread too thinly, they have been wasted or 
dissipated with little to show for their expenditure* Where they 
have been concentrated, the results have been frequently encou- 
raging and sometimes dramatic-, 

Others, however^ begin with the belief that governmentai intervention m most 
areas of social f^licy is typically ineffective, or worse still, that it generates more 
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New York Times, February 27, 1973, "The Short Rope^ " This editorial rejects a 
statement in President TJixon's radio talk on "Human Resources" where the President 
asserts that money for social programs fo aid the poor had flowed from Washington 
"in a seemingly inexhaustable flood. " The Times argued that there was no flood and 
that "Every Great Society social program wub beriously underfunded — at levels below 
Congressional ouihorization—because of spending on the Vietnam War between 1966 
and 1969* . * , Some of the* • . programs" need more monc>, others need more time^ 
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problems than it solves. They interpret *nformation that reports the limited success 
of educational intervention, for example, only in such a way that it corroborates with 
what they already knew; and thus they recommend that the programs be ended or 
assigned a low fiscal priority. Government should do as littte as it can politically 
get away with. If the data had shown that there was improvement, they might have 
rahed the issue of the cost required to produce a benefit, or they might have explained 
that the success was due to "creaming. " Positive findings are perhaps a bit more 
difficult to explain away than negative findings, but the difficulties are not insuper- 
able |ust as negative findings can be discounted as the outcome of measurement 
errors, or the diffuseness of goals, or of an Insufficient input. !n the very frequent 
instance oF inconclusive findings, different parties can choose which findings they 
will pay attention to. In these and other ways paradigms can be defended against 
new data. The conclusion to be reached from this example is that research findings 
may be used to support the view you already hold, but that if they do not support it, 
they need not be interpreted as invalidating it. 

These conclusions are not limited to one field of social policy, nor are they 
fresh insights unnoticed by other observers. In his reflections on ths vigorous academic 
debate over the busing of children to racially integrated schools and whether it affects 
their school performance, James Q. Wilson has formulated two general laws to cover 
all cafes where social scientific evaluation judges public policy programs. He argues 
that either all interventions produce their intended effect or none do, depending on 
the prior beliefs held by those who conducted the inquiry. This anomaly arises largely 
because different standards of evidence and methods are applied, but also because the 
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some evidence Is subjected to different interpretation and weighting. 

Studies that conform to the First Law will accept an agency's own data 
about whqt it is doing and with what effect; adopt a time frame (long or 
short"^ that maximizes the probability of observing the desired effect; and 
minimize the search for other variables that might account for the effect 
observed. Studies that conform to the Second Law will gather data 
independently of the agency; adopt a short time frame that either mini- 
mizes the chance for the desired effect to appear or, if it does appear, 
permits one to argue that the results are "temporary" and probably due 
to • o , the reaction of the subjects fo the fact that they are part of an 
experiment; and maximize the search for o^har variables that might 
explain the effects observed. 



So cial Policy Paradigms and Utilization of Reseorch 

Three obstacles that inhibit the influence of research on policy development have 
been briefly reviewed. The first two difficulties, namely, the difficulty of reconciling 
the ideals of democrocy with the ideals of impartial rationality, and the complexity 
of the social events which research needs to understand and predict, have received 
attention in the literature.. Neglected, but perhaps of greater importance, Is the 
third problem thoi all knowledge must relate to a framework of interpretation, because 
information only makes sense in a framework that interprets it. If knowledge is to 
be useful in a collective way, politics aside, a widely shared viewpoint of interpre*- 
tation is "equired. There are, however, only competing perspectives, and research 
cannot aid in chocslng among them but makes sense only in terms of them. This 
conclusion offends our cherished allegiance to the view that learning from experience is 
not only necessary but possible. If policy commitments are only with difficulty informed 
by evidence, what can we count on? Wt^at can we do? 
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James Qo Wilson, "On Pettigrew and Armor: An After Thought, " The Public Interest, 
Q No. 30 (Winter 1973), p. 133. 
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The work of Kuhn, especially his concept that paradigms are replaced In 
response to crisis, may be relevant for understanding the contribution of social science 
research to established social policy paradigms. Kuhn argues that science does not 
develop only by the gradual accumulation of new knowledge, the correction of previous 
error, and the addition of new discoveries but by a series of crises In adaptation. Normal 
science proceeds, first, from puzzle :>olving within the context of an accepted para- 
digm that organizes disciplinary realities. Anomalies are discovered from the usual 
puzzle-solving activities.and these become increasingly hard to assimilate into the 
dominant paradigm, A scientific crisis emerges when scientists become aware that 
the paradigm's organizing capacity has collapsed and a substitute Is at hand. Because 
there is a substitute available/ abandonment of the earlier paradigm becomes possible. 
Othervv'ise, people will stfll cling to the earlier formulations. The crisis Is followed by 
a scientific revolution m which a new integrative paradigm Is constructed, usually 
by the powerful insight of a single man of genius — although fundamental discoveries 
are seldorri uniqud. What foliov^3 then is a struggle for acceptance, because the new 
paradigm offors n reformulation of the problem and a redefinition of the kinds of 
data rhor Leur un trie problem. In tl/nes of crisis, the scientific criteria of interpre- 
tation gre themselves in doubt. The acceptance of the new paradigm Is a strategic 
decision Lj:od ^^n the judgment that it vvill contribute to a more complete understanding. 
As such, ft is very mjch like a radical policy decision. Cver time the new paradigm 
is itself subject to the same process of challenge and assoult. Science, then, develops 

9 

as an alternat-ion of crises and sustained exploration of an established line of thought. 

Thomas Kuhn, The Spreading of Scie ntific Revolutions , 2nd ed., Chicago: University of 
Ch icago Press, 1970, pp. 10"'?5, For criticism^ of Kuhn, see I. Latakos and A. Musgrave/ 
eds. , Criticism and the Growth of Knowledge, Cambridge University Press, 1970. 
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Turning lo "ocial science, one can see a parallel with Kuhn's interpretation 
about the development of science. Knowledge about social issues, to be useful in 
a collecHve way, presupposes g widely accepted framework to interpret it* By analogy 
with Kuhn^s analysis, we wouid expect: 

lo That research Is not generally designed to challenge the paradigm but to 
develop understanding within the framework of its assumptions^. That is, if o 
policy does not work, the evaluation is not taken to discredit it but to refine 
and converl- the particular application of the theoryo The negative evaluation 
Is itself chaH.Miged and fault found with the method by which the research 
conclusions were reacheda This procedure should lead to continual improvements 
in the power and sophistication of the theory and more successful applications* 
2o That this process will lead in time to a crisis of confidence in the theory 
when it heroins to show more ond mor-^ unaccountable inconsistencies with the 
evidence. A new theory, with different implications, a different sense of 
moral responsibility, a reconception of the problem, will then take its place 
and run the same course ^ 

But does the relationship between rc-corch and social policy follow this pattern? 
Are there really sociol policy paradigms? Is there ever such a consensus of approach? 
And if these pare I'gms direct research, does research reciprocally undermine the 
paradigm? Science is a more or lass self-enclosed system, where research Is its v/hole 
life* but research is only one influence (perhaps a very small influence) on the 
determination of social policy<, Two possible approaches to these questions arc 
consideredo The skeptical position leaves ilttle scope for losearch to contribute ro 
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policy; the cautiously optimistic view suggests a potential role for research and is 
preoccupied with ways that this rok could be made more effectiveo Both perspectives 
warrant further analysis and debate^, As with most competing paradigms, evidence can 
be marshalled in support of either interpretation. Choice between these orientations 
ts a matter of faith, not truth. Pragmatically it may be advisable for anyone interested 
In policy research to assume, as an act of faith, that if the quality of his work is good. 
It will be worthwhile and useful in the long run, even if he cannot krww whom it will 
Influence or when^ But there is no more sense in his worrying about the ultimate 
validity of his enterprise than in a research scientist worrying about the philosophical 
foundations of induction^ It is much easier in practice to recognize good research — 
its moral sensitivity, the coherence and power of its interpretation, the carefulness of 
its method, the quality of Its evidence, and the imaginativeness of its insight than 
it is to explain why or for what purpose it is goodo It seems useful to present both 
interpretations here and then to develop at further length the more optimistic one, 

A Skeptical View 

Policy is determined by a complex perception of social, economic and political 
Issues on which social science theory and empirical research findings are only one, 
rqther ofjscure influenceo According to the skeptical view, policy paradigms change 
In response to social, economic, and political changes — that is, they change because 
they have to rationalize a different reality, not because research has revealed how 
wrong was the interpretation of earlier circumstances. Given changes in socio- 
political and economic realities, there is a scromble for new ideas, and a new paradigm 
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IS sought which con serve as an organizing framework for the development of specific 
programs. This new policy paradigm is, of course^ determined by ideological preferences 
as well as by social and political realities. Bui it is the changed reality that shapes 
acceptance of a different paradigm. Still, the older frameworks are not altogether 
forsaken: administrative pragmatism and eclecticism provide continuity with the post. 
Therefore, policy influences new theoretical formulations, inspires research, and fashions 
the relevance of the findings. However, the reverse relationship does not hold. 

There is seldom, if ever, a consensus over policy: there are always competing 
paradigms. Thus, research on social policy never acquires the relative consistency of 
interpretations found In scientific work. For example, much of the writing on poverty 
has taken place within a conceptual framework that sees poverty as a function of inadequate 
opportunities or resources to establish a reasonable quality of life. As this paradigm is 
developed, it absorbs Jata about the lesser opportunities of the poor for advancement, 
their inadequate living conditions, their greater incidence of disease, and their lower 
life expectancy. AM these observation:, extend and enrich the fundamental idea that 
poverty is injustice and that much of this injustice has to do with an inequitable distri- 
bution of opportunities and resources to ailer life situations. But these same data, peiriaps 
given different emphases, and organized v/ith different oLoervations, could contribute 
to the enilchment and developm.ent of btill other paradigms. For example, poverty may 
be seen as anorher culture, a way of life in v/hich, perhaps, having uncommitted time 
Is more important than the amassing of human capital through education or job experience. 
Vtituully the same data, given different v/eighting and organized differently, can 
serve both parcidigms. This implies thot the interpretat'< n of research findings is 
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dways controversial, because they are related to different paradigms held by different 
people, and there is no way of arbitrating between these interpretations by any rational 
method. It follows, then, that policy-related research never develops the same fundamen- 
tal axes of interpretation, since it is not focused within a common framework of 



assumptions. 



An Optimistic View 

The main planks in the skeptical platform are that evidence does not help in the 
social choice among competing frameworks of thought, and that research follows policy 
developments, and the framework of values which contains them, but the process is 
never reciprocal. The optimistic view holds that public policy typically evolves from 
what is initio.ly a common framework ofthought, without which there would be no 
action at all. Res< arch in rhe short run contributes to policy when findings are consistent 
with the accepted framework. In the long run, research and theory contribute as 
well to alterations in the framework . As a oolicy-relevant social science develops 
In sophistication and experience, it will increasingly serve policy objectives. Studies 
of the utilization of commissioned and noncommissioned research In the decision-making 
process would, if an adequate time frame were adopted, reveal that there is more scope 
for high-quality social scientific investigation than the skeptics allege. 

We may consider the optimistic position in more detail. It does seem clear 
that no consensual social theory is as well worked out as the dominant theories in 
the noturol sciences. Nevertheless, there ore paradigms and interpretive frameworks 
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\haf ore dominant among political actions. They are translated into legislative 
programs that capture, at least for the moment, views held by large segments of 
the population. Policy does represent a consensual framework for action. T. H. Marshall 
argues that ^'Without a foundation of near consensus no general social welfare policy 
would be possibleo Such a consensus is an intrinsic part of most stable contemporary 

societies, although it is not possible to say with precision where the consensus comes 
fromo Marshall believes that it is part of an autonomous ethical system that Is neither 
the summcition of individual preferences, as revealed In the market, nor the outcome 
of interest group pclJcies mediated by the democratic process. By its nature, this system 
of values is intrinsically authoritarian and paternalistic^ 

While multiple and complex social policies exist among the subunlts of government 
at all levels, the confiictG between them are nevertheless subordinated to the more general 
social policy that contains rhem^ In periods when the consensus Is strongest (e.g. , after 
wars and economic reversals), poiicy flourishes. However, It languishes at those times 
when accord cannot be reached. 

If policy is largely framed within a consensual framework, then the skeptics' 
position is o>/erstGtsdo Sccial science . .'Ifjdge does contribute to the iinprovement 
of social programs when It is bcs^d upon widely shared values and when the political 
competitirn among vested interest groups is 'jt a minimum. When social science inquiry 
does not orrempt to demonstrate that values need to be changed, wo would expecr 
research findings to be very useful. And this is especially true for a field of settled 

10 

T. H. Marshal?, "Value Problemr, of Welfare Capitalism, '^ Journal of Social Policy, 
VoL 1 (January 1972), p., 2U. 
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policy wh^re the crucial task Is thai of administration and implementation, but it is 
also truo for a field wher^ policy makers define the research agenda, 

Tf^e usefulness of research for policy varies, then, with the type of research 
undertaken, its source of financing, and its administrative relationship to the policy 
makero Seen in these terms, the urgent question is how to reorganize and refinance 
research so that it can better serve policy cbjcctiveSo When research is undertaken 
at a high degree of particularity it is mo likely to fit a framework shared by political 
actors to meet the requirements of administrationo One approach at reorganization 
takes the view that politicions qnd administrators should just specify the knowledge they 
require and should then purchase it from universities and other sources, paying 
a reasonable fee for o produc* called "informationo " Such commissioned studies are 
likely to create little tension between research and action, since the researchers have 
a contractual obligation to provide a product specified in advanceo It Is when these 
circumstances are satisfied that research is likely to be most used. 

Such a situation holds when the primary task of the study is technical — to 
devise ways to alter the known poor fit between available resources and accepted aims. 
For example, how can a city's fire service be reorganized so that it is more efficient and 
effective in its own terms ? Rese.^rch is useful when it can provide better approaches 
for getting things done within the existing rerms of reference of the bureacracy. Paren- 
thetical ly, we mi.jht note that it U the administrators of such programs who become 
the important consumers of research findings and not necessarily the executive branch 
which might commission it as became evicent in the course of research conducted 
by the Rand Corporation for the City of New Yorko 
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Research can aiso be useful to policy when ft sets out to discover negative side 
effects that can threaten the political acceptability of a prograrr.o Sometimes govern- 
ment will create ex ante studies which monitor whether it is achieving its purposes* 
For example, in 1971 the British Parliament decided to discontinue the provision of 
free school miik to children over seven years of ageo To quell political opposition/ 
the bill called for a dietary and clinical survey of children in selected areas to monitor 
the impact of the policy on the physical well-being of the children exposed to ito 

This type of research contrasts with the more typical arrangements where research 
proceeds from the social scientist's discipline rather than from immediate policy con- 
siderationso In such cases, the research questions, methods, and time requirements 
are not framed so as to take account of the political constraints of power and the 
bureaucrotic constraints of mandate, and this accounts for their limited usefulness in 
the short run. 

The Rothchlid report on research fx)licies for Britain seems basically to accept 
the assumption th^ t these are the processes which limit the contribution of research 
policy. This report distinguishes between "basic research" and "applied research 
and developmento " Aside from a small ib'ed proportion of research funds to be allocated 
for freewheeling or basic researcn, most research funds available to scholars outside 
the government should be allocated by governmental atf/ortments acting as "customers" 
to academics acting as "research contractors^ " The customer will both specify the 

n 

The example is drawn from a stimulating memorandum prepared by Antony King, Uni- 
versity of Essex, England, titled "On Studying the Impacts of Public Policies, " January 
1972 (mimeo), po 2* 
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^ r.>^ I'jni fo be studied and ^eview tiie methods of inquiry. The more immediate, as 

vvell the long range, icqulitment:> of ^overnnient deportmenfs will shape the research 

1 ? 

agortd ' This poiicy accept^, os a self-evident truth the proposition that research 
studies iL^^uested by odminisrrators and politicians, and paid for by the government 
department thai commissions rhom, s/ill be useful to policy makers because they are 
based upci: an Inteiiecijui perspective .! ored by both researchers and governmentc It 
follow.'; from tliis vie',vf>cint that if the research interests derive from a perspective which 
is not shaiod by juve.nmoni, thtj '.nmediate usefulness of the findings will be in questioHo 
Only if the findi.^g^ are so compelling or sc graphic as to convince those who do not 
share the sumefr jmcwork ofthought will this rot be true. And for the reasons reviewed 
earlier, this seldom occurs. The less the framework is shared, the less immediate will 
be the impact of research on policy in the short run. However, this conclusion is based 
on on assumption cLojt the stability of tht dominant paradigm. When paradigms are in 
transition, re>eaich that choMenges earlic-r frameworks may become more, rather than 
less, inHo ntiaK ifriv will be rtvie\.'L'd .uter.>; 

But the apprcGv-h :;Aprcssed in the Rothchild reportengenders consternation among 
these r-.sponsibU Kji in~jujjrc::r;nc. ^ .^arcn. h' tabs them of the autonomy they deem 
essentJ'ji foi inJ, ^jcndenr r.r.d ci^^ativc anal ^s:-; it substitutes shorlH'erm experimental 
gains fo, jnJ rnoic fundQni<:,'';r j! in:>. jLrs,, and i^ thus I'lireotens what is mo:>t essen- 

tia! to scichco - • cpen, independent inquiry informed by the researchers* curiosity, 

12 

''The O.-gornzoKm and Management o? <^ovi.rnment R & D," J\ Framework for 

Gov >rnrnor.r K.-^t^w-ch and Dc c^^.^ pt—.t L..ndrMi: HJA S C. (Cjnnd, 4814), 197U 
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wifh minimum externGl constraints. Moreover, the policy itself is untested, for it js 

not based upon any prior analysis of the relationship between research use and the nature 

of the contractual relationship with researcherSo 

An alternative approach for increasing the usefulness of research to government 

proceeds on a different assumption. It calls attention to the weakness of the process 

by which knowledge is diffused and relevant information assimilated. The knowledge 

needed by the policy maker may be available, but he does not have access to it 

either because he fails to recognize that it exists, or because the information Is 

so technical that he r'oes not appreciate its practical usefulnesso What are needed 

arc intermediaries who can effectively relote the four autonomous segments of a highly 

interrelated system — that of politics where policy is made, technology where hard 

and soft Innovations are born, professional and administrative practice where established 

policies are implemented, and research, David Donnison has expounded this view and 

recommends that "We nus** develop social networks of creative, well-trained scholars 

v/ith a policy oriented turn of mind, capable of moving in and between the worlds of 

proctice, politics and technology* They must be firmly rooted in the academic world — 

whether they v/ork in universities or not — that the / keep in touch, intellectually 

13 

speaking, wilh stuc'ents and colleagues there. 

There ore numerous variations on the general theme that policy makers and 
researchers r-iust find // /: *o interact with each other. Some researchers view the 
policy maker as pan of the research proce:>s and insist that both me^et perlodicaUy 

13 

David Donnison, "Research for Policy, " Minerva , Vol» X, Noo 4 (October 1972), 
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to discuss their tentative findings, so that users of the research product are involved in 
the process of study. The assumption is made that participqtion enhances the comrnitment 
to make use of the study results and to view research as a process and not simply as a 
conclusion. 

On the other hand research may be viewed not a^ a cooperative venture In which 
it server us an aiiy to established policies (whether by formal contractual relotionship 
or by an informal process of communication t3nd learning), butoi^partofa political process 
which ln^•olves disagreement auJ contention- The controversy may be accepted as a 
natural fi»nction of a well-working machine, as a factor contributing to the breakdown 
of the machine, so that a different type of operating mechanism may become necessary. 

Research may serve as morgi witness or as social criticism. When it does so, 
it accepts, in common with those studies commissioned by government, a shared set of goals 
and a shared conception of the instruments and processes for achieving those goals. 
In good Weberian tradition, the researcher maintain^ that the social scientist has no 
authority ^o challer^ge statemem^ of purpose. His research is not trying to persuade 
those who hold different values or are committed to alternative means of achieving 
them. Me is practicing only internal ciiticism of the means-ends chain because his 
aim IS to demonstrate that those involved in a given policy have failed to under- 
stand the consequences of their own actions. This kind of research also assumes 
that once n.^gative facts are knowr;, everyc ne must accepr iheir moral implications. 
It proceeds vrom tl o p'o::Jso r. at t'lore is a conbensus of opinion about purposes, so 
that if the facts aro vr'! and the Implications are judged undesirable, government 
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will act to rectify the conditions or account for Its failure to do sOo Research Is thus 

used as a strategy of shame, to embarrass government to do what it accepts as morally 

righto Of course- the assumption may be faulty when government's declaration of 

intend turns out to be only symbolic; then exposure will not lead to effective action 

but to a scramble for new symbolic programs. 

This strategy is not always applicable^ Research can monitor v^hether policy is 

achieving what it has set out to do only if government has a policy to implement, that 

Is, if it has established a definite, unambiguous course of action directed to a specific 

and definable aim. But this is seldom the case. Government typically lacks coherent 

policieso For example, it may spend money on in-patient health services, community 

care, and hospital construction; and these expenditures will lead to a very definite 

pattern of resource allocation within the field of medical care. But this pattern is brought 

about by the Independent decisions of a wide variety of bodies, each made disjointedly, 

mfrementaliy, and unrelated to each other. Government as a whole has no over-all 

resource allocation policy; hence reseorch cannot demonstrate a mismatch between 

aims, underlying processes, and outcomes, in these circumstances, research may act 

as social critic calling attention to the failure of government to "consciously choose a 

14 

particular course of action or a particular allocation of resources. " Itcannot act as 
moral witness dcr.onstratfng how governmenr has failed to honor its commitments, because 
there were no cummitments; government had surrendered to a non-policy. Research as 
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social criti may, In addifion, set out to show that the picture of reality Implied by 
existing intervention is false, muddled, or inconsistent* The outcomes cannot be as 
intends- J, pither because there was no initial intent or because rhe world works 
differently than imagined by the policy makers. 

Research as moral witness and as 'ocial criticism is much harder for governments 
ro Gssirrillate, to accept, end to act upon in the short run than the consensual studies, 
in part because it challenges the conventional interpretation of reality and because 
it does not accept the constraints of resources and purposes under which governments 
act. But even here reseoich does not ques ion the values themselves, except indirectly 
by implying that something has gone wrong in the weighting and ordering of multiple 
and conflicting aims. But the governments do, over time, come to incorporate the 
views of their critics. Thus, research that is either consensual (contract research and 
intermediaries who make the supply and demand system for information work effectively) 
or contentious (moral witness and social critic) can influence the direction of policy. 

The optimistic argument reviewed so far establishes only a limited terrain 

within the framework of a dominant paradigm in which research can contribute to 

shaping policy. But can more detached analysis that challenges the very assumptions 

15 

on .yhich policy ..peiates also exert influe ice? 

Wht^n ro^earch attempts exanilne the voluos that underpin policy, one form it may 
taku is that of a philosophical reappraisal of ethical and ideological perspectives 
lather than an empirical inquiry inio facts and realities. Polemical essays s-ich ar 
Michael Young's, The Rise of the Meritoc racy can be as insightful and revealing as 
more empirically based studies, because they spell out the logical consequences of 
pursuing a particular perspective. 

23 



28 

Dominant policy paradigms are by no means static and unresilient. They may 
bo resistent to invalidation, but they are also open to development. They evolve over 
time. And social science idc i:>, together with social, political and economic changer,, 
play a role in the development ot these policy paradigms. The process is a complicated 
one and it is difficult, if not impossible, to isolate the unique role of research and to 
diseritar.gle whether research is a cau.e of policy or a consequence of it. The 
influence of research is often diffuse, oblique, and always embedded in the changes 
it reflects. The Interplay of knowledge and ideals, political maneuver and intelligent 
problem-sol vino \ coond to be very subtle, ambiguous, and complicated — o subject 
which itself an Important theme for empirical research. 

Schcmaticuli/, it may be possible to represent one possible context in which 
reseorch cor.fributes ic boilc policy changes^ First, there is a broad consensual 
frame/vork, v/hich icpresents //hot Parsons calls common values. These common values 
have csn integrctive efft*ct upon society. Social processes are, by definition, a mode 
of integratic»n or social ccricrs; fhe very fact that we have a society means that basic 
value differo s onong men will be worked out. Society is best viewed a:> potentially, 
mutually, bcicncioil/ Interoc iing unlt^. Thio corsonsus, in turn, helps to create a 
politico! ^cr»fc/^ rhnt shapes lesearch priorities and helps to define the agenda of what is 
regarded j'o useful Inquiry end oc-ceptable social science theoi*>. Values, politics, 
and robeoich form o closely intervvoven fabric. Over time there are disceriiible changes 
In the churoctei of rho fabric. T'.ese are brought aboijf by technological changes, 
v/hlch, in hjrn, I? flu-'rce . v(..-f. a$ well following them, Thvs research il^ r;ot simply a 
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passive servanf to its economic and political masters. It molds, as well as is molded 
by, the consensuol framework of values that prevail in society at any moment in time. 
In this process, social science research and theory help to evolve an ideology of 
thought; and this in turn influences the values that subtly alter the economic, social, 
and political context as well as being influenced by them. Social science may take 
the form of social criticism during one era, and its idea? may be repudiated for the 
moment because they threaten the status quo. But in other periods, especially during 
times of economic change and political unrest, there is a searchjor new ideas to 
help legitimate, make understandable, and direct these broader societal forces. 

\\ seems that the optimistic view must assume an integrative concept of society 
defined in terms of common values, and it must reject the competing view that the 
mode of being of any society Is predominantly a conflicting one. At any moment in 
time, it may be possible to show that a consensus of opinion has been achieved and 
this might lend support to the position that society is best viewed in an integrative 
mode. In the conflicting model of society it is assumed that a common valye framework 
and stability are achieved through the imposition of one group's standards an another: 
integrotion can thus be interpreted as the dominance of one group over another. Power 
in society allows only the realization of the goals of the dominant group , and it 
frustrates the goals of the subservient one. 

Two examples drawing on different time perspectives may illustrate how research 
con help to change policy paradigms. The first example, taken from the field of 
mental health, explores how the subtleties of the processes are worked out in the short 
run, over a period of a decade or so. The second, tracing the development of policy 
if> regard to those who are econoniccllydesf itute, looks at the s.ome process over 
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a rriucf ionger period spanning two centurieso Robert Rapaport has suggested thai the 
diffusion of social science knowledge may follow a biological analogy: new Ideas, 
like new organs, may first be rejected by the body, but then may gradually experience 
semi-acceptance, until finally the new organ is incorporatedo A theory to account 
for this process of repudiation and final embrace of social science knowledge has 
not yet been devolopedo Some who hcve observed the phenomenon feel that interme- 
diaries and an informed network of colleagues play important roleso To understand 
the contribution of research and organizational policy, it is necessary to take into 
account the time lag between Initiation and acceptance and the subtle process of 

rejection and partial or eventual acceptance, since this May take place over a period 

CI ,^16 
oF ceve'rji generations, 

A study undertaken at the Chestnut Lodge Sanitorium and eventually published 
by Stanton and Schv/crtz in thqir classic book. The Menial Hospital, illustrates how 
some of these processes in the diffusion of research findings can operate in practice. 
The study, by a socioiogist and a psychiatrist, attempted to show the potential scope 
cf '^milieu therapy" for patients in a mental hospital. The analysis provided a critique 
of psycho-analytlcally oriented psycfiotfic^up/ rhut emphasizes one-to-one relationships 
between a patient and his physician in Isolation frorn ri.o administrative and organiza- 
tional milieu In v/hich the therapy takes placo<. The researchers trtcd. In their Inquiry, 
to documcnl" the way: In which the context undcj mines the therapei^fic procesSo They 
isolated specific i>ocial processes, cuch as covert dlsogrut^ment among the staff, and 

Robert No Roji-uport, "The Therapeutic Communiiy ^.o visited: Some Aspects of Social 
Science Diffusion, " rnimeo, n»do 
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•were abit; to illustioro the effects on patient behaviofo This research thus revealed 
an impoitcnt fla,\ It >,cakened the belief (the paradigm) that recovery from mental 
illness can bu aciuuvtu! ^ok i; rhrougb interaction between the patient and his 
herapisto This critique of ihe hospital's operating assumptions was so fundamental that 
rhe hospital as a whole could not accept its implications for the running of the institu- 
rion, nor its inphcit and explicit recommendations, without witnessing a ma|or upheavaL 
Oddly, the research study, which received wide acclaim, was accepted as an importont 
analysis by members of the staff of the host hospital, but its findings were ignoredo The 
study was wlJely ,.1 by professionals In otner iDstitutions and by the next generation of 
sociologisls and cli iicians. There »s little doubt that at least toir- people had already 
come to believe in the desirability of reaching a different bclcnce be*-v.cen individuo! 
and milieu therapy , The IrtroHuci ion of new drugs around 1956 provided a nev/ tech- 
nology, and thi.s couid nov. make a different approach feasible. But in order to present 

a cogent orgunierit for theli viev/s, they had needed empirical research that provided 

17 

persuasive documenration. The Stonton and Schwartz book, published in 19-^, 
and other subsequent studios provided a useful ally. Together with subsequent research 
that ulcc\ ro !'^-^-' scciai form and patient bohavior, if helped influence the general 
climolc- of . io' ;'^. i)/ irJr r}Q GMjilablo fos the first time empirical evidence that could 
offer i. r.-liecto.ii ju^if'r. ition for a new pproacho Although this point of view had 
always bou ; in the iiocrjnl clinate, no evidence had been mor'shaled to demonstrate 
or articulate it ir v/os ou^y ahoi he stud> became kno«^/r that the framework w^s 

Alfied ii. Stanton and Morris S. Sch;/artZ; The Mental H ospital, New York: Basic 
Books, 1954. 
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accepted as a serious therapeutic approach^ Findmcs of the study came, in time, to 
play an important role in the education of clinically oriented personneL Thus 
teachers served as intermediaries linking research to its potential users^ Young 
people who went to work in state hospitals were Influenced by the general notions 
underpinning the research, and they further developed its implications for the structuring 
of wardso Some of the younger psychiatrists who worked at the Lodge at the rime the 
study was conducted, and were influenced by it, also carried the concepts to other 
hospitals and saw them implemented. They too played the role of intermediaries, 
spreading the approach to new settings. There is unfortunately no firm evidence that 
the hospital which initially rejected the findings came later to be influenced by them* 
But institutions are not monolithico They do not react as a whole to innovative ideos. 
Apparently some members or units of the hospital came, in time, to accept certain 
aspects of the study; and several othef milieu projects did follow the btanton and 
Schwartz study. But it is difficult to interpret whether these reflected the iriieiests only 
of specific stuff members or acceptance of the findings and the general approach by 
the hospital as a whole. 

As a second example of how studies contribute to changing policies, we can review the 
treatment of the pooro Farly nineteentli-century political economy developed the view 
that those who accepted poor relief should be "less eligible" o\ more uncomfortable 
tlian the lowest puIJ independent laborer. Thio guiding metaphor vjos translated into 
legislation and er .bodied in the Poor Lav/ Amendment Act of 1834o To implement this 
principle, o major policy innovation was required in Br!t<nn. A central authority and 
a small paid inspecTorote set out to abolish the local practice of aiding ^he destitute in 
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fheir own homes (outdoor relief)* Relief was to be offered only to those who agreed to 
enter a workhouse. These were then to be classified as able bodied and non-able 
bodied, and the ablo bodied were to be subjected to the p^iiciple of "less eligibility. " 
Ihe aim of the legislation was to drive th^ able-bodied poor back into the labor market 
where they could win personal dignity through work. The New Poor Law was interpreted 
as a final solytion to the problem of pauperism, for it would reshape the mcral character 
of the able-bodied poor. 

These administrative reforms,, and the critical ideas on which they depended, 
owed their origin to the sociol theories developed by Bentham and his followers. The 
Poor Law Reform of 1834 offers an example of the inv. jence of a normative theory 
of political economy upon legislation at a time when the development of the factory 
system required a more mobile labor force to serve it. Theory helped to explain and 
to guide the public response to an industrial order organized around market principles 

of supply and demand. 

But the New Poor Law of 1834 HIJ uo\ result in the promised efficiency. Research 

throughout the nineteenth century in England attempted to discover the anomalies in the 

New Poor Law paradigm, and it served as the nucleus upon which modern social policy 

grew. "The disrant future lay v/ith those v^ose empirtcnl obser>/atior^s enabled them 

to repudiate the p raiyzing fatalities of ri.o principles of 1834 and the theory on which 
18 

fl'-ey rested. " 
18 

R. McGregor, "Social Research and Social Policy in the Nineteenth Century," 
British Journal of Sociology, Vol. 8, No. 1 (Morch 1957), p. 148. 
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Policy-oriented social science in the mid-nineteenth century was narrowly 

empirical in focus, aimed at describing social conditions and measuring ^'the economic 

19 

costs of the social wastage inherent in unregulated industrialism^ Its purpose was 

to discredit and to expose the inadequacies of the New Poor Law doctrine which 

established a rigid distinction between poverty and pauperismo Official statistics 

showed a steady G*^c!ine in pauperismo The number of paupers on relief fell from 

808 percent of the population in 1834 to 2o5 percent by 1900« These statistics 

suggested that improved poor law administration and a rigid standard of living had 

20 

together combined gracefully to eliminate poverty as anurgent social problem. 
Yet, the studies of Booth in East London (1887) and Rowntree in York (1899), based 
on what in their day were massive statistical surveys showed that about 30 percent of 
the population had incomes inadequate to maintain themselves. These facts lent support 
to a new theory of collective responsibility, which was further developed in the writings 
of the Webbso The Webbs believed that citizenship should provide each individual with 
the right to a nationally imposed rrinimum standard for education and training^ employ- 
ment and income retirement, medical core, etc. Once the principle of universal 
entitlement was accepted, there weie stiil competing options left open as to how these 
goals could best be satisfiedo But rhe new guiding policy metaphor influenced the 
course of legislation in the early twei tieth century and helped produce the Beveridge 
Report and Hie reforms of 1948, which ushered in the era of the welfare state. 
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Quoted In O R. McGregor, op..ciLw p. 146<, 
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Michael Eo Rose, Jhe Relief of Pov> r ry 1834-1914, London: MacMillian Press, 
1972, p. 15. 
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Otice these reforms had been implemented, they too became the subject for new 
empirical investigation and criticism: Beveridge's approach failed to produce the 
guaranteed rr.inimum it promised. New theory came to replace earlier conceptions 
of the mmimumo Poverty is ix?w viewed by at least some social scientists, such as 
Titmuss in Britain and Rainwater in the United States, as inequalities in the command 
of resources, and especially those inequalities that derive from the exclusion of 
specific groups from the dynamic and evolving life style, rights, and opportunities 
available to the average members of society. If the earlier principles were forged 
from studies that sought to document the wastage of unregulated industrialism, the new 
principles are evolving around issues of equity in the distribution of public resources: 
who pays and who benefits and who is excluded from established policies? Does the 
distribution of public largess nultiply privileges or redistribute advantages? Empirical 
stpdies have provided preliminary documentation for the generalization that in the 
context Of a democratic liberal political system it is the middle class that benefits most 
from the high-cost .ectors of gove; nnnontai intervention; and the broader the definition 
of social poiic/, the more neariy dooo this applyo The social policies that emerge from 
this prospective reject rnin^num x^bsistencc as a relevant goal of public intervention and 
reject the conceorion of po/urty as a failupi to achieve subsistence standards, defined 
in abcoiun.' V/hen fKDverty I" 'ie//od as exclusion from membership in society, 

public ;>3iioies becncric neccssor/ which will attempt to alter fhe distribution of resources. 
The impact rhcr thoi^e new ideas may hove on future policy remains uncertain, but a 
debate along tpo>.: lines has been launched. 
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This brief review of the development of policy paradigms in regard to poverty 
is broadly consistent with Kuhn's ideas about the way in which paradigms can be 
modifiedo The examples suggest that research evidence does help to make an assault 
on older, vvidely held policy paradigms and that these new findings make it harder to 
interpret knowledge in the accepted way and also contribute to the development of 
new paradigmso In this view, social science theory and empirical research play a 
definite part in \Ue complex process by which society constructs its perceptions of 
reality, defines what its problems are, and determines what principles of intervention 
should guide Its action und inaction^ 

Ar^ the Skeptics or the Optimists Right? 

It is a mistake to assume that the matter Is settledo Which is more valid, the 
skeptical or the optimisKc view, depends on an act of faith rather than on evidenceo 
More systematic research on research may suggest that the contribution of research to 
fX)IIcy Is limited, either because analysts ha/e failed to provide useful answers to the 
questions about v^ich government is concerned (most studies dispel myths rather than 
propose so!ufions), or because government cannot asbirilate or use the knowledge, 
when it is av'aiiablo, for a variety of odmlnistratlve and politico! reasonso However, 
those who \\avQ taitL t lai reseaicii and social science can be used o/ government will 
continue to seek ways iri which our understanding of social processes can be improved 
and the obstacloo to utilization overcome* 

But it is not oniy the policy maker's perspective which needs to be taken into 
accounts The jesearchor too must corne to terms with tho,T 'So have power to make 
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policVo He can fallow one of three broad strategies. He can proceed to work out 
his analysis in the abstract, unrelated to the political process, and without asking 
where the policy backing for his conclusions will come from. He can assume that 
there h and ought to be a division of responsibility between those who set out to 
describe reality and those responsible for action. But If this approach creates a 
situation where there are no takers, because the research findings are ignored by those 
who have power to make decisions, the researcher may then proceed in a different way. 
He may, for example, conduct his work In such a way as directly to Influence those who 
have power, or, alternatively. Interest groups in oppositfon to established power. But 
he may then have to give up some autonomy to buy Influence, The only way to avoid 
this Is for the researcher himself to enjoy a positfon of power (usually because he has 
achieved scientific prestige from other contributions), and thus be able to meet established 
power on an equal ground. If he enjoys a positfon of status, then what he says may not 
altogether be Ignored. The researcher has only three choices with respect to power: 
he moy ignore It, leaving it outside his considerations; he may subordinate some of his 
autonomy to power; or he may have an independent base of pov^er won by his own prestige. 

A Modern Research Str ategy in the OptimtcHc Tradition 

We have reviewed three research strategies In which empirical findings contri- 
bute to the development of policy: a consensual approach , whereby government 
contracts for the informatfon It wants or Intermediaries make the knowledge morkot 
work better by bringing together knowledge producers and knowledge users; a contentious 
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approach, whereby research octs as moral witness for the failure of society to honor 
its commitments or as a social critic w hen government has established no commitments 
to be honored; and a paradigm-challenging approach, whereby the researcher acts 
independently of the established paradigm and tries to expose its fundamental weak- 
nesses and to propose alternative principles of intervention, under the assumption that 
political support for the assault will follow at a later time. Each approach can contri- ' 
bute to policy. While research is typically undertaken within one or another of these 
frames of reference, it is however not uncommon for a single study to shift from one 
strategic level to another to accommodate the varied motives of the researcher. But 
the kind of evidence needed to advance each strategic position is different. If researchers 
want to be influential and to avoid personal frustrations they must be clear about the 
interpretive context in which their studies are framed, and also about the different levels 
of evaluation. This means that those who conduct empirical research in the hope of 
being useful in the development of policy must guard against two dangers. The first is 
the subti-^ transition from one style of analysis to another, so that the conclusions drawn 
will not follow from the original premise. For example, a researcher may attack a para- 
digm but nevertheless want to be of immediate use, which in most cases is not possible; 
thus he may be led fo make a setof recommendations which are altogether irrelevant to his 
starting assumptions; or a researcher may refrain from using his radical perspective in 
fashioning his research design, but nevertheless impose it in his final appraisal of 
directions for action. The second danger that th.eatens the credibility of the analyst 
is the confusion of levels of analysis. For example, he may have evidence to show 
that a program does not work, from which he may inappropriately infer that the theory 
of intervention is misconceived or that the goals it espouses cannot be implemented. 
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These two difficulties often overlap because the style and level of analysis 
intercept, A consensual approach proceeds from agreed-upon aims; it asks whether 
policies, and the specific programs that implement them, work as Intended* Program 
evaluation provides, of course, one of the basic ways that sue' ;in assessment can be 
made, A contentious approach proceeds in a more disputatious manner, searching for 
the very areas :r. society where our social ideals are not honored, not because we try 
and fail but because we do not make an effort in the first instance, A paradigm 
challenge occurs when the validity of a theory of intervention is brought under scrutiny. 

How then do we move ahead to develop a viable social policy paradigm? /'though 
little systematic work has been done on the study of complete paradigms which can guide 
us in the formulation of a specific social policy paradigm, it would appear that we need 
to address at least three main questions: (1) What are the main goals or purposes to 
be pursued? (2) What theories or principles of intervention might be pursued to achieve 
these purposes? (3) How can \^e determine whether ,»rograms are in fact consonant 
with these theories, and whether, in fact, they work as intended? An integration of 
the answers to these three questions will hopefully constitute the substance of a policy 
paradigm. 

As we have suggested, the stjdy of paradigms must consider not only the specific 
elements of the paradigms, and their relationship, but their dynamic interplay within 
the broader sociol, political, ona economic contexts. The following section , however, 
IS a more limited andcircumscribed presentation. It examines the purposes, strategies, 
and programs of social policy, perse, withoul considering their relationship to the 
broader social setting in which they are located. 
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The Disparity Between Ideals and Realities 

Since a social scientist has no claim to moral authority, what contribution can 
he hope to make to the question of social goals? One thing he can do is to undertake 
empirical studies to documentthe disparity between existing ideals and established 
realities. As a member of society he has an intuitive sense about the kinds of disparities 
which may be most acceptable politico But whatever process he employs to select 
a problem for study, he proceeds on rhe a.oumption that policy should attempt to narrow 
the disparaties which are revealed. Of course, this works best for those ideals m 
society on which there is :»ubstantial accord. But is there agreement about our social 
ideals? While some measure of consensus about social aims does appear within a 
specific sector of social policy, it seldom obtains for all sectors. Decisions are typically 
made by autonomous departments without much attention to each other and without 
being subordinated to a single unambiguous policy objective. Governments seem uncom- 
mitted to a single embracing purpose but tend to seek multiple aims that are contradictory 
and conflicting. And yet despite this co. if I let of intentions and seeming absence of an 
exj. licit consensus and social purpose, those who hold an integrative view of society may 
after all be correct in believing that there is an elusive consensus on a deeper level. 
Superficially, we sec a discordance of belief systems and ideals; the underlying agree- 
ment and integration in so^iiety is hidden and may take some effort ro be identified. 
Thus, the social ideals and belief systems that underpin them are not self-evident; they 
need to be discovered. This is the first task of the researcher as critic, 

I expect ' lat there is no rigorous way that the analyst can tap the crucial issues of 
the day. But an examination of the way in which Issues ore brought to public attention 
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for action suggests that the pattern may be cyclical. In Britain, for example, in the 
mid-1950's, researchersandpoliticions were apparently preoccupied with the problems 
of the aged. This slowly gave way to a concern for poverty among children, then to the 
problem of low wages, and most recently public attention has been riveted on the 
circumstances of the disabled. Perhaps one process by which the researcher may uncover 
issues and illuminate their importance can be explalnecj in the following way. When 
the treatment of special groups seems inconsistent with an implicit ethical standard, a 
diffuse dissonance is established which announces that the state of affairs is morally 
wrong. The researcher understands this dissonance from his role as citizen and from 
his moral sense of what offends him, and is thereby guided in developing his research 
questions* 

The researcher then attempts to dacument the size of the disparity between shared 
ideals^^ and actual performance — on the grounds that the case for change is more 
compelling if large numbers of persons arc affected. Thus, quantitative studies of the 
incidence of hunger, poverty, ill health, chronic unemployment provide evidence about 
the seriousness of the gap between ideals and realities. These can then be used to 
argue that the disparity needs to be redressed. Pressures for reform are substantially 
strengthened if they assimilate not only the idea that something is morally wrong but also 
the idea that this state of affairs is socially dangerous. Pragmati-n thus reinforces 
morality, each appealing to Its own constltutency. Whi'e need and demand studies 
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Some research tries to develop new social ideols; for example, some studies have tried 
to demonstrate that technological developments have made work redundant, so that we 
should prepare for a society that allocates work rather than leisure as a scarce resource. 
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may support a variety of paradigms, they tend mainly to reinforce those paradigms that 
arise from impatience with the status quo. This is because "need" oriented research 
always uncovers unmet needs. By definition needs are rarely fully satisfied and social 
ideals are almost never in accord with social reality. No one actually expects the 
real and ideal ever to be identical. We may note, however, that the evaluation of 
real programs presents the obverse problem. To start with ideals suggests that we may need 
to do more. To start with p rograms suggests that whatever we do fails, because 
research reveals the failure to achieve goals. Critics will note that the size of the 
problem is a function of the standard of need employed. In judging the scope of the 
problem, the crucial issue is the definition of standards. 

Democratic political systems operate in such a way that they are responsive to 
strong political constituencies. Many public policies win support when they are 
initiated by interest groups that are articulate and powerful. Sometimes the interest 
group involved is mainly interested in keeping quiet the gains it has won, as in the 
case of business interests that have won generous oil depletion allowances. It some- 
times seems as though it is a peculiarity of welfare policy that the case for its reform 
is expected to be substantive as well as political. Interest groups are therefore interested 
in marshaling whotever empirical evidence or persuasive argument they can develop 
to suppoif their cose. However, the kinds of arguments which the spokesmen for 
welfare programs develop to identify the state of dissonance will tend to influence mainly 
those v/ith whom they share the same culture end values — in short,the same paradigms. 
To widen political support,spokesmen for welfare programs tend to broaden their argument 
so that it will appeal to different groups. However morally compelling an argument may 
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bo on ground^; of eqjity and decency — that the poor should have decent housing, 
because it is dehur^anizing in an effluent society to subject individuals to a lower 
standard of v/eii-boing rhan that enjoyed by most members of society — it is seldom 
politicaliy persuasive. To win support, the case for decent housing is therefore 
stretched: good housing will reduce juvenile delinquency and enhance the capacity 
of children to make use of their sci.ooling, because, among other things, U will 
provide them with a place to stud, . Those interested in reducing crime end expanding 
education are advised ro .wpport ihe case for better housing. But the validity of the 
argument becoiir- -t-jkei as the search for political support i$ broadened. And in the 
end, the persucnivenessof reformers lies more in their ability to apply pressure than in 
the substance and mora! justification of their arguments. 

Another v ay to broaden support is to present appealing or dromatic imagery to those 
who hold differrv^i pc.rodigm? but who are not strongly committed lo them, or those who 
hold conflicti-c, [.firadignis simultaneously. New Imagery may even affect those v/ho are 
a!rec:J> cc^mi, ...'o -o a- ■ ,>po- :) ocuadlgrn by shaking thoii conviction in the essential 
rightne.'. of a! oi ihjy L iieyc Ojjlitutlve studies pla/ an Important role In this 
process, xif-rii- - u c. .(C.-. ; ;-jr A/ it.- -:c. e'fccri >q use of such studies because they 
are iirnitea i.-y "-■■yKi ,;;o.e and o e seldor.i ab'n- to evoke a sense of affront and 

our;ag- T' ■: ■'- f ' ! • " t-ft^^ttively achievoJ b/ iou.nalists and fiction 

writes. fiH^ir re^.iting can .-Ic^eiop n,:v, imagery about reality c.ia may influence 
people to -xc:minc modify their poradlgms. These vi /id accounts can also evoke 
empathy o. the f.x>r, she -Ick, or.d rhe disenfranchised, and call attention to the negative 
social conieque-. ■ ol poverty, i ir- ss, and alienation. 
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Theories of Inrervention 

Having documented the failure to achieve ideals, those who wish to influence 
public policy must then consider wliat kind of theory of intervention can help reduce 
the disparity between ideals and reality. A policy paradigm is incomplete if it fails to 
specify how goals might be achieved. Research can confront existing theories of policy 
intervention, and it can also contribute to the development of new theories. But in 
either event, it will not be definitive in invalidating or in producing theory. Social 
theories reflect world views of how society functions, but policy paradigms are broader 
than scientific theories, which account for causal chains leading to particular events, 
because they contain normative as well as descriptive dimensions. They are also 
different from values about what constitutes a social good, because they embody not 
only an ideology of ends but an ideology of means which suggests how these ends can 
be realized. Oddly, they often contain only an implicit political theory as to how these 
means can be implemented. Whatever theory is developed, it must be at once ideolo- 
gical and empirically linked to real social processes. If it is to be politically possible^ 
that is to say piactical, it must be phrased in such a way that ii is socially acceptable 
within whatever seems to be the arena of decision making. 

Consider the paradigm which holds that an individualistic society should provide 
its members v/Ith the opportunity to step up the social ladder. Th, paradigm embodies the 
Ideal of equalizing opportunities, and that of assuring that a permanent underclass does 
not develop v/hereb/ disadvantages are perpetuated from one generation to another. It 
should be noted that n^ost studies ^cial, occupational, and income mobility have not 
been organized v/ithir, apolicyoractlonfianiewoik. Thus, 'h(.y merely describe andanalyze 
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the paHernof social sfratifioqtion and social mobility within sogiety, and are therefore 

of little immediate use in the formulation of specific policie5. Policy does not 

necessarily flow logically from a review of patterns and trends. However, such 

descriptions do contain an Implicit normative framework* Tho$e interested in policy 

will search these studies for qiges as to the factors that frustrate opportunity, $o that 

action can be bosed on an Interpretation of these processes. 

The Initial values of the paradigm, however, do not determine the final form of 

Intervention, Are institutional barriers the crucial factor in inhibiting the equalization 

of opportunity, or i^ individual Incapacity a more urgent obstacle? "Equalization of 

opportunity, " after all, may function to eliminate the "incapable, " Yet theories of 

Intervention to encourage individual social mobility tend to favor either an Individualist 

or a structuralist perspective, if for no other reason than that limited resources force a 

reluctant choice. It seems that a theory of intervention must follow one of two directions 

for policy. Each view "presumes a different conceptual framework, steers attention 

to different variables, poses problems of a different order, and suggests different 

22 

methods of approach to solve these problems, " ^ 

The dominant theory of inrjrvention in regard to equalizing opportunity holds that 
increased educational achievement by individuals is crucial to the alteration of oppor- 
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Roland R. V\/arren, *7he Sociology of Knowledge and the Problem of the Inner Cities, " 
Social Science Quarterly, December 1971, p, 473. Logically, Warren observes, we 
may not need to make a choice: 'Msn't it perfectly possible to consider poverty as an 
jntegiol property of the social structure, while at the same time acknowledging. . . 
[that] individual people may experience serious sociol handicaps because of their 
poverty, and may need individual help to overcome these deficiencies?" 
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tunity, although the precise process by which this occurs is subject to different inter- 
pretations* The failure to acquire cognitive skills is most often assumed to be the 
critical foctoro But recent research has attempted to challenge these accepter/ theories 

of intervention, A study by Christopher Jencks convincingly shows that the /elationship 

23 

between educational achievement, IQ, and future income is very marginal. Jenck's 
study, by calling attention to dispersions within a given level of educational achieve- 
ment and nenlecting the difference in the means between groups, brings 'nto question 
the belief that the educational establishment contributes greatly to inecualities in 
eventual class position, not to mention the assumption that there is a compelling 
relationship between IQ and economic success in later years. To tranple so unrelentingly 
on cherished ideas without proposing alternative theories of intervention must create 
ideological confusion* It is not surprising that Jencks and he colleagues have been 
accused of being both too radical and too conservative; yet what seems most certain 
in the absence of o politically viable alternative theory of intervention is that their 
findings will very likely be asslmi!a*^ed by all paradigms without causing dramatic change, 
unless the ideals of equalizing opportunity are totally repudiated or a different theory 
of intervention posited. 

An example of a different ideal is the proposition that the promotion of individual 
mobility is less essential than the pror^orion of collective mobility., This approach does 
not attempt ro eliminate stratification, but it does seek to change the deyree of inequa- 
lity by shifting the position of the groups at the bottom lelative to those at the middle 
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Christopher Jenr.ks, et oL, lnequal: ty; A Reassessment of the Effect of Family and 
Schooling in Americo, New York: B'-tsic Books, 1973> 
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or top* It would accomplish this by raising their prestige levels, working conditions, 
salary levels, fringe benefits, or some combination of these approacheso This view 
directs attention not to the failure of the poor but rather to the failure of the mecha- 
nisms for allocating resources and prestige among different occupational and social 
groupings* 

Yet another theory has been developed by theorists which calls attention to the 

existence of a dual labor marketo It is crgued that the low- and high-wage sectors 

are discrete and discontinuous. Low-wage employment is characterized by dead^^nd 

jobs in which there is little opportunity for on-the-job training and econo aie^^ii^ances. 

As long as these jobs exist, certain types of workers ~ the less well educated, youth, 

vyomen, ethnic minorities — will be attracted to them. Policies directed to changing 

the characteristics of the individual, such as their skill, educational achievement^ 

and motivation for work must in the end fail if no effort i? made simultaneously 

to alter the structure of job slots in the labor marketo After all, if native workers 

refuse to ciccept these dead-end, low-paying, }obs that are subject to high levels of 

unemployment, industry will recruit migrant labor for whom these new jobs will 

represent an improvement in their relative economic position. The crucial task, then, 

is to alter the structure of employment by redefining tasks within a job, and a job 

vyithin an occupation (an institutional theory of intervention) rather than the stnjcture 

24 

of individual opportunity (an individual theory of intervention.) 
24 

See, for example, Peter B, Doeringer, ''Low Pay, Labor Market O-jalism, and 
Industrial Relations Systems," Discussion Paper No. 271, Harvard Institute of Economic 
Research, January 1973. 
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Program Evaluation 

Specific programs translate the broadly defined theory of intervention into concrete 
actions, and it is fhese programs that are the object of evaluation. The case for 
evaluative studies is compelling and perhaps self-evident. What, after all, could be 
mere rational than to evaluate the outcomes of public policy? There is no sense in 
enthusiastically supporting policies or reform if we never find out whether they work. 
Yet, although the case for evaluation may be self-evident, here, too, we observe that 
prior paradigms tend to invade the methods of analysis and the interpretations of the 
findings. 

One strongly held argument maintains that if we are to produce better information 
about which government interventions work and which do not, it is necessary to design 
social progiams deliberately as experiments. Reliable and valid information about 
social processes and social programs can only be gathered through the experimental 
approach, where random selection is the crucial strategy. Social scientists must 

"prepare themselves so as to be methodologically ready for a future 'experimenting 

25 

society. * " 

An alternative framework proceeds from the assumption that experimental evalua- 
tions miss cartain processes and outcomes crucial to an understanding of any program 

intervention. One implication of this approach is that the study design is less important 

26 

than the existence of a prepared and sensitive observer to the process. The emphasis 
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Donald T. Campbell, "Critical Problems in the Evaluation of Social Programs, " a 
paper prepared for the annual meeting of the Division of Behavioral Sciences, National 
Academy of Sciences, May 19-20, 1970, p. 1. 
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Robert S. Weiss and Martin Rein, "The Evaluation of 3 cad Aim Programs: Experimental 
Design, Its Difficulties, and an Alternative," Administrative ^^.ie nee Quarterly , March 1970. 
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on observation rather than on research design responds to three problems encountered 

in traditional , experimentally oriented studies: 

lo There is a tendency to concentrate evaluations on Immediate, discrete, 
quantitative measures of change, even if outcomes cannot be measured 
in that way and even if they are not altogether related to the purposes of 
the intervention^ 

2o Evaluative studies have a tendency to eschew the long-term, slow-maturing, 
qualitative changes that are hard to measure in favor of short-term changes, 
even when such a procedure imposes alien goals on a program^ 
3o There is a tendency to evaluate programs in isolation from the context in 

which they must operateo For example, compensatory educational programs 
may be evaluated within the context of a particular school but ignore 
the external forces that impinge on it. Yet a school may go through 
a yearly financial crisis because it must balance its budget by April although 
state reimbursement funds are not decided until Juneo Teachers must be 
notified six months in advance of dismissal ~ so they may be dismissed in 
April only to be rehired in June. Such a procedure could have a demoralizing 
effecf on their morale. The negative ospect of such policies and procedures 
may far outweigh any positive contribution that the compensatory program 
could have on the children's educational achievements^ 
In brief, then, traditional evaluations yield uncertain findings because they are too 
crude and narrow in the aims they purport to measure and too short-term in their scope* 
Moreover, the attention to outcome alone neglects the broader institutional context in 
which the program operates, and thib can nullify whatevir positive results may be achieved^ 



Differences of belief do not only suggest competing methods of evaluation; bur also 

conflicting ideas obvof the purposes and findings ro emphasize in the evaluotJon. 

Peter Morris^ commenting on the experiments with community action and model 

cities in the United States, and community programs in Britain, argues thai "The 

distinctive qualiiy of these experiments in social planning is their attempt to 

explore the adaptability of the process of government to demands: first that they should 

Dring the people they serve into their counsel, as party to the discussion, negotiation and 

choice of policies, and secondly that they should integrate the functions of government 

27 

intelligently arounJ .>*oblenis as a whole. If the experiments are seen to be concerned 

with the malleability of government to innovation rather rhnn with the development of 
strategies for reducing poverty, then, clearly, they musi- be judged by different standards. 
Measures of the performance of government rather than short-run achievements of the 
individual are required* This interpretation exposes the unresolved question concerning 
the purposes of experiments with broad social aims. 

But even when there is general agreement about aims, and objective evaluations 
are undertaken to determine whether thc^ hcve been met, at the crucial moment decisions 
about the continuation of a program may b.. jud-jed by altogether new critertOo Thus, 
programs which L:ctually succeed in meeting their purposes may nevertheless become 
unaccefitab'e. For oxarr.ple, i* is v/iJciy assumed that the experiments with community- 
contiolled schools were lejected because they failed, but in fact "Iho decision to abolish 
the experimental districts was made in the absence of dotu on the effects of tliis experiment 
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Peter Morris, "Experimenting in Socio! Reform," mimeo,. 1972, p. 6, 
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on schools and children. " Marcia Guttentag qrgues that community control, which 
has been widely acknowledged as a failure, was In fact, based on findings of later research, 
a success. One of the aims (and many have argued, the prime aim) was to change the 
behavior, aspirations, and attituder of ghetto residents through a strategy of participation^ 
People change as they try to change their world* The Horlem experiment with community- 
controlled schools created deep conflict between professionals and consumers, but it also 
changed the aspirations of the adults gnd increased the educational achievement of the 
children who participated in it» 

Conclusion 

Each type of study yields different information and Is responsive to a different 
questiono There Is a danger that we may shift our levels of analysis and draw 
conclusions from inappropriate sources of data. It is, after all, difficult to determine 
when the theory of intervention is right but the program implementation is faulty, or when 
the theory is wrong because the ideals which led to the theory are miscosto At least three 
different options are possible: (1) The ideals were right but the implementation was 
inappropriate, perhaps because the design of the program v/as faulty, or the level of 
commitment was insufficient, or the critical threshold was not reached (the medicine 
didn't work because the dose was too weak)o (2) The ideals were right, but the theory 
of Intervention was wrong^ Educctionjor example, is not a key to the equalization of 
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Marcia Guttentag, "Children in Harlem's Community Controlled Schools, " Journal 
of Social Issues, Vol. 28, No. 4 (1972), p. 18o 
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opportunity and income because the link between education and Income is very elusive 

and indeterminate in a society whose occupational structure is changfn*^* (3) The 

ideals themselves are impractical: no theory of intervention could achieve them and new 

Ideals are needed. Banfield has argued, for example, that the effort to alter the time 

preferences of ghetto adults, that is, their ability to plan for the future, is a self- 

.29 

defeating task and that new and more realistic goals are required* 

In evaluating a policy paradigm it is important to be able to assess whether the 
ideal, or the theory of intervention, or the program which translates that theory into a 
specific course of action is defectiveo 

Program evaluations can only say something about program implementation^. Many 
evaluative studies of the poverty programs were of limited use because they only irKjuired 
whether the programs worked or not — these "go-no-go" studies could not suggest how to 
make the programs woj'^ better. When the Ideals remain firm and the theory of Interven- 
tion Is unaltered, research seems useless if it is unable to suggest areas for specific program 
improvements For example, so long cio there has been a continuing commitment to the 
iegitimaie goal of helping youngsters compete on equal ferms in school, and it has 
been assumed that eai !/ education i:. impori-ant in shaping academic achievement and that 
ability is related tu future income, negative findings about the Head Start program have 
simply proJuccd c diffuse sense of dissntlsfaction and frustration, discrediting both the 
value of research and the program. 
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Somehow evaluaHve studies seem, in the end, almost alwqys to react against the 
reform itself, to support the preconceptions of those who believed to begin with that 
nothing works. But from these observations we cannot conclude that we should be satisfied 
with the reforr «ithout evaluation. Few would argue that reform is an oct of faith end 
that what matters ,he faith and not fhe outcome. If we are concerned about outcomes, 
then v;e must see th it progroms do what they are intended to do. But because evaluations 
seem so consistent" .o osxault the reform itself, there is the danger that negative findings 
may give premature and unwise support to the cynical and th^ reactionary and may 
discourage and demoralize the idealistic. 

As we suggested earlier, if one is interested in criticizing the theory of intervention, 
rather than the specific program, it is necessary to look at processes and try to examine 
whether events occurred as they were supposed to. That is to say, were the Inputs to be 
evaluated those called for by the theory? For example, if community action theory holds 
that all interested parties should collectively define the problems and priorities of ghetto 
residents, n- ' thereby create new programs out of this assessment, then the test of the 
theory requires a study of these processes. We would want to know whether things worked 
out according to program intention. Such a reviev' might show that the program did not 
orise from the processes implied in )he theory but v/as imposed ad hoc. And so the validity 
of the theory cannot be in question because the theory was never implemented, and hence 
its effec .venoss cannot be judged. The nonr.c' support for outcome studies and rejection 
of process studies show yet again how the study of the effectiveness of policy is itself 
collected to undetected paradigms, 

' If one wants to question Ideals rather that the theory or the programs that are the 
objects of the evaluative study, then resc irch needs to ro- examine the assumptions on 
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which the ideals are based. For example, if structural unemployment persists, so that 
a substantial portion of the population is always unemployed, the ideal of equalizing 
opportunily can or.ly mean equalizing the risk of being unemployed. 

The sriongest conclusion to be reached, then, is that we should not draw conclusions 
from the results of one kind of lesearch when the results actually follow from another type 
of researcho Social policy research is at great risk of being totally inconclusive because 
it moves too quickly between ideals, theories of Intervention, and program specifics 
whe n no 3uC h progression can rightfully be drawn frorri the research. To use research 
productively, it is important to ue clear at what level of analysis the research is relevant* 
There is a danger of drawing inappropriate conclusions about ideals and theories when the 
data relate only to the implementation of programso 

1 have tried in this paper to illustrate the resistance of persona! paradigms to 
change and ihe stubbornness of cat^gorlca of thought despite alternatives suggested by 
research^ Skeptic^ take this as evidence that only a weak link is possible between research 
and policy. Optimists aryue that such a conclusion is premature. Research undertaken 
within a common framework of thought can both by contention and consensus influence the 
development of policy; moreover research M^d theory can help reshape policy paradigms as 
v/ell, but theii conlribution cannot be isolated from the n::any otiier forces that impinge on 
decisionso i i^avc .et out the argumen-s in support of each position as irnpartialiy as I can-) 
In the final section 1 have tried to illustrate how prior-held fram?:*wo.ks shape the ideals 
sought (the skeptic's viow), the theories of action propo J--* d/ and the evaluations under- 
takeno The optimists, of course, reject this view and polnl to tf^e many examples in the 
short and long run where researcl: does appear to contribute \ :> |X>licy« But the process by 
which this occurs io a complex one. iV\ore importontl/, ! ♦ i ? tried to show that policy- 
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oiiented research Is in danger of falling into disrepute when researchers inappropriately 
shift among the three levels of analysis discussed* I on: therefore a skeptical optimists 
Self-conbcious awareness of the limitation of each view permits one to avoid being the 
victiiTi of eith-^ro 



